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1.   INTRODUCTION 

This  paper  is  a  sequel  to  a  paper  by  Gear  and  Tu  [l]  which 
discussed  the  stability  and  convergence  of  variable  step  multistep  methods. 
A  familiarity  with  that  paper  is  assumed.   Just  as  the  stability  and 
convergence  of  multistep  methods  depend  on  the  step  selection  scheme 
they  depend  on  the  order  selection  scheme.   This  paper  considers  conditions 
under  which  order  selection  schemes  do  not  make  a  constant  order  stable 
multistep  method  unstable.   It  is  shown  that  the  interpolation  step 
changing  technique  used  with  Adams  formula  is  stable  provided  that  both 
the  step  and  order  remain  constant  for  r  steps  after  any  change,  where  r-1 
is  the  current  order  of  the  method.   The  variable  step  technique  for 
changing  step  sizes  used  with  Adams  methods  is  shown  to  be  stable  with 
respect  to  any  order  and  step  selection  schemes.   In  fact,  this  is  shown 
to  be  true  for  all  "constant-p"  methods;  that  is,  ones  in  which  the  corrector 
coefficients  (a*...,  a*)  are  independent  of  the  step  and  order  selection 

_L         K. 

schemes . 

Although  the  most  common  reason  for  switching  from  one  formula 
to  another  is  to  change  order,  there  can  be  other  reasons,  e.g.  one  might 
switch  between  Adams  and  stiff  formulas  of  the  same  order  because  of  a 
change  in  the  stiffness  of  the  system.   Consequently,  we  discuss  "variable 
formula  methods"  rather  than  just  variable  order  methods. 

In  [l]  it  was  shown  that  a  step  selection  scheme  which  produced 
step  size  changes  small  in  the  sense  that 

n+1  =  1  +  0(h) 


h 
n 


gave  stable,  convergent  interpolation  or  variable  step  methods  if  the 
underlying  multistep  formula  was  stable.  This  result  is  extended  to 
show  that  for  any  class  of  strongly  stable  formulas  F   =  {F.|i  =  1,  2,...}, 
there  exist  constants  p.  such  that  both  the  interpolation  and  variable 
step  methods  based  on  F   are  stable  with  respect  to  small  step  changes 
provided  that  the  formula  selection  scheme  guarantees  at  least  p. 
steps  are  used  without  change  once  a  method  based  on  F.  is  selected. 
This  result  is  demonstrated  to  be  sharp  in  the  sense  that  classes  of 
weakly  stable  formulas  may  give  instability,  and  that  the  p.  have  to  be 
larger  than  one  for  some  classes  of  strongly  stable  formulas. 


2 .   BACKGROUND 

To  simplify  the  presentation,  single  number  references  are  to 

the  paper  [l].   Numbers  of  all  definitions,  equations,  theorems  and 

lemmas  in  this  paper  are  prefixed  by  2.   Thus,  Theorem  2.3  is  the  third 

theorem  in  this  paper,  while  equation  (IT)  is  in  reference  [l]. 

The  way  in  which  variable   step  and  interpolation  techniques   are  used 
to  generate  methods   M.    based  on   formulas   F.   was  previously  discussed  in    [l].      In 

a  variable  order  method,  we  have   a  set  of  formulas  {F.li   =  1,   2,...} 

i' 

(possibly  of  different  orders)  with  an  associated  set  of  methods  M.  which 

depend  on  the  step  changing  technique  used.   Changing  from  one  method  M. 

to  another  M.  may  require  a  special  operation  0...   Hence,  we 
J  J  i 

state: 


Definition  2.1 

A  variable  formula  method  is  a  set  of  multistep  methods,  {M^}3 
With  underlying  formulas,    iF.}j   and  operations  for  changing,    {0 .  .}. 

Definition  2.2 

A  formula  selection  scheme  I  is  a  function  I(h,t)   such  that  the 

formula  used  for  the  interval   [t  ,    t    ,  J   is  FW7    _,_    ..  where  h  is   the 

n'     n+lJ  Kh.t  ) 

n 

controlling  parameter  in  the  step  selection  scheme   (see 
definition  1). 

Examples 

Al.       Suppose  the  set  of  formulas  is  the  set  of  i-step  explicit  Adams- 

Bashforth  formulas  F.,  i  =  1,  2,...,  k,  where  k  is  the  maximum  number  of 


steps  ever  used.   If  the  variable  step  technique  is  used  for  changing 
step  sizes,  then  the  method  is  given  by 

yn+l  =  yn  +  3l,n  hn-iyn  +'"+   3k,n  Vk  yn-k+l' 

where   if  a  method  based  on  F.    is   in  use,   the   B.        are  determined  by 

i  J  »n 


=  0,        j    >   i 


and  the   requirement  that  the  method  have    order  i.      No  special  action 
is  needed  to  change   order.      The  vector  of  saved  values   can   formally 
be  defined  to  include  k  past  values   of  the  derivative  by 

Zn=    [V  Vlyn"-"  Vk  yn-k+l]T> 
and  the  method  can  be  represented  by  the  matrix 


A     = 
n 


l,n  2,n 

0  0 

1  0 
0  1 


— 

k-l,n 

\n 

0 

0 

0 

0 

0 

0 

1 

0 

_ 

0  0 


and  the  vector 

^  =    [0,   1,  0,...,   of. 

The  method  changing  operations  are  represented  as  matrices,  in  this  case  by 
the  identity,  so  0.  .  =  I. 


A2.       If  the  Nordsieck  form  of  Adams  method  is  used,  and  step  changing 
is  handled  by  interpolation,  we  have  from  equations  (9)  through  (12) 


*n 


=  K>\-iK Ci^k)/k!]T> 


A     =  A  C    , 
n  n 


where 


A  = 


111 
1     2 


.     1 


l 


1 
I 


if  the  method  is  currently  equivalent  to  an  i-step  method, 

On.«Uag[l,^-.(^-)2....,  (^-)k].  , 

n-1     n-1         n-1 

and  I      is  the  vector  for  an  i-step  method  extended  to  k+1  entries  with 
-n 

zeros.   In  this  case,  changing  the  order  may  involve  some  operations. 

Decreasing  the  order  can  be  done  by  dropping  the  higher  order  derivatives. 

Since  they  are  ignored  in  lower  order  methods,  we  can  take  0. .  =  I  if 

i  <_  j.   When  the  order  is  increased,  we  could  elect  to  start  with  zeros 

as  approximations  to  the  new  derivatives  required  in  which  case  we  could 

take  0.  .  =  I  also  for  i  >  j.   Another  common  way  of  increasing  order  is  to 

only  allow  an  order  increase  of  one  at  a  time,  and,  if  the  order  has  just 

increased  to  j  ,  estimate  hJ  y   /j  !  by  aomputing  l/j  times  the  backward  difference  of 

h    y     /(j-l)l.   To  do  this,  we  need  to  save  the  previous  value  of  the 


latter  scaled  derivative,  so  we  must  modify  A  to  be 


p 


A  = 
n 


111 

1  2 

1 


J 


when  an  i-th  order  method  is  being  used  and  i  <  k. 
Then 


i+l,i 


1 

1   -1 


i+1  i+1 


(2.1) 


(i+l)-th  row 
(i+2)-th  row 


(2.2) 


XJ 


produces  the  required  difference  since  the  (i+2)-th  row  is  used  to  save  the 
previous  value  of  the  i-th  scaled  derivative  when  the  order  i  is  less  than  k 
"We  will  call  this  the  difference  method  of  changing  order. 


Difference  between  examples  Al  and  A2 

Since  the  Nordsieck  representation  is  a  transformation  of  the 
multistep  representation,  there  do  exist  matrices  0. .  for  the  Nordsieck 
representation  such  that  changing  the  order  in  the  latter  representation 


is  equivalent  to  the  method  used  in  Example  Al.   However,  these  matrices 
are  complex  (a  discussion  of  what  is  needed  for  Adams  methods  can  be 
found  in  Shampine  and  Gordon  [2]).   A  representation  is  chosen  with  a 
view  to  making  computations  simple.   Therefore,  we  expect  that  if  the 
Nordsieck  vector  is  used,  the  interpolation  step  changing  and  order 
changing  techniques  discussed  in  A2  will  be  used,  whereas  if  a  multistep 
representation  is  used,  a  variable  step  technique  and  the  type  of  order 
changing  discussed  in  Al  will  be  used.   For  this  reason,  we  will  talk 
about  order  changing  with  variable  step  and  interpolation  step  changing 
techniques,  meaning  that  the  type  of  order  changing  discussed  in 
Examples  Al  and  A2  are  used  respectively. 

2.1  Stability  and  Convergence 

When  the  formula  changing  process  is  represented  by  a  matrix, 
as  above,  we  can  derive  an  error  equation  similar  to  equation  (20).  It 
will  be 

-n+1    n  l  , ,  i  — n   — n ' 
n+1  n 

where  i   is  the  number  of  the  formula  used  on  the  step  from  t   .  to  t  . 

n  r       n-1     n 

To  simplify  the  notation,  we  will  write  0   for  0.    .  ,  and  T  =  q  0  . 

n  i     .  i    '  nDnn 

n+1  n 

Stability  and  convergence  were  defined  in   definitions   2  and  3 

with  respect  to  a  step  selection  scheme   6.      For  variable   formula  methods 

we  extend  the  definitions  in  the  obvious  way  with  respect  to  formula  and 

step   selection   schemes . 


/ 


8 

Definition  2.3 

A  method  is  stable  with  respect  to  a  step  selection  scheme  6 
and  a  formula  selection  scheme  I  if  there  exists  a  constant  M  <  «> 
(dependent  on  the  differential  equation  only)   such  that 

\y  -to   |    <  U\v  -y 

for  all  0  <   t     <   t     <  T .  where  y.  and  y.  are  two  numerical  solutions. 

Definition  2.4 

A  method  is  convergent  with  respect  to  a  step  selection  scheme  0 
and  a  formula  selection  scheme  I  if  the  computed  solution  y     converges  to 
y(t  )  for  any  0  <_t     <_  T  as  h  ->  0  and  the  starting  errors  -*■  0. 

Definition  2.5 

A  method  satisfies   the  stability  condition  with  respect  to  a  step 
selection  scheme  6  and  a  formula  selection  scheme  I  if  the  matrices 

¥"  =  T     ,5     „   . . .   T 

n         m-1     m-2  n 

are  uniformly  bounded,where  T     is   the  value  of  T     evaluated  for  the 

"         °  n  n 

differential  equation  y'  =  0. 


Theorem  2.1 

If  a  method  is  stable  with  respect  to  8  and  J,   it  satisfies 
the  stability  condition  with  respeat  to  6  and  I. 

The  proof  is  identical  to  the  proof  of  Theorem  1. 

In  the  discussion  below,  we  will  usually  refer  to  (k+l)  x  (k+l' 
matrices  and  (k+l)  element  vectors.  Any  vector  norm  and  subordinate 
matrix  norm  can  be  used.   When  a  matrix  is  partitioned  and  a  norm  of 
one  of  the  partitions  is  used,  that  norm  is  defined  as  the  norm  of  the 
(k+l)  x  (k+l)  matrix  obtained  by  replacing  all  other  partitions  by  0. 

Thus,  if  X  is  a  (k+l)  x  (k+l)  matrix,  and 


then 


[•] 


A  ,'  B 
I 1 

C  !  D 


B 


0  i  B 

i 


Thus,  |  |x|  |  <_  |  |a|  |  +  |  |b|  +  I  |c|  +  I  |d|  I . 

The  same  definition  is  used  for  the  norm  of  a  part  of  a  vector. 


10 

3.   ADAMS  TYPE  METHODS 

As  with  fixed  order  methods ,  varying  order  methods  appear  to  be 
less  stable  with  the  interpolation  technique  than  with  the  variable  step 
technique.   We  will  prove  that  a  class  of  formulas  which  include  Adams 
formulas  are  stable  with  respect  to  any  formula  and  step  selection  scheme 
if  the  variable  step  technique  is  used.   However,  we  can  only  prove  that 
Adams  formula  is  stable  for  the  interpolation  technique  if  the  step  and 
order  are  periodically  held  constant  f or  p  steps  after  a  change  to  an  r-step  formula, 
where  p  =  r  if  the  O^s  are  the  identity,  and  p  =  r+1  if  the  difference  method  is  used 

The  next  theorem  is  a  straightforward  extension  of  Theorem  2. 

Theorem  2.  2 

If  a  method  satisfies  the  stability  condition  with  respect  to 
0  and   J,  if  the  quantities  a3   a*j  3  and   3*  or  A     and  I     defined  in   [l] 
are  uniformly  bounded^    if  the  0  .  .  are  bounded  and  if  the  truncation 

I'd 

error  satisfies 

I  \d  I  I    <  h     e(h)         ¥■   j 
1  '-rc1  '   —    n  n 

where  e(h)  ->■  0  as  h  -*■  0S    then  the  method  is  stable  and  convergent,   and 
there  exist  constants  k-  and  k4  such  that 

I  1^1  I   1^    llitfll   +  *4  e(h) 
for  0  <_t     <_T. 


11 


Theorem  2.3 

If  a  variable  step  method  uses   the  corrector 

+  *0,n\<+lf~-+K,nhn-mK-mH> 

where   the  a*,  are  independent  of  the  step  sizes  and  formula  used  (we 

oall  these   "constant-p"  methods) 3   if  the  3*       are  uniformly  bounded. 

%3n  j  j 

k  k-1  0 

and  if  p(E,)  =  -E,  +  a*  E,  +  ...+  a*  £  satisfies  the  stability  con- 
dition, then  the  method  satisfies  the  stability  condition  with  respect 
to  any  step  and  formula  selection  schemes. 

NOTE:      If  an  explicit  method  is  used,   the  predictor   coefficients   a. 
must  satisfy  the   constant-p    and  stability   conditions. 

Proof 

From  equation  (23) 


12 


S      =    (I    -  I      £f  A 
n  -n  -d         n 


a* 
1 


a£-i 


a 


o       o 


l,n 


5*  .  S* 

m-l,n       m,n 


C  '  D 
I    n 


0  ,  L 
-    i     —i 


Since  the 


are  uniformly  bounded,   the       S 


n+pi 


are  uniformly 


.m 


bounded  for  0   <   p  <  m.      From  the   structure   of  S    ,  we   see   that   L     =  0 ; 
—      —  n 


hence   if  p  >   m, 
;n+p  _ 


,p-m   /^m-1 


,m-2 


.0 


C*  "   (C         EL+  C         D„.,L  +...+  Cw  D 

Ti  n+1 

0 


n+m-1 


L111"1) 


Hence 


&+»\\  <  ||oP||  ♦  i|Cp-mn  iic 


m-1 


D  +. . .+  D  .   ,L 
n       n+m-1 


m-1 


for  p  >  m.   However,  C  is  the  companion  matrix  of  the  polynomial  p(£). 
Hence,  if  p(£)  satisfies  the  stability  condition,   |Cr|   and  ||C    |   are 

bounded.   Hence  I  Is  P|   is  bounded  for  all  p  >  0. 

1  '  n    '  — 

Q.E.D. 


Corollary 

If  the  3.  and  8*   are  chosen  to  achieve  maximum  order  (at  least 
l      l 

m  for  the  predictor,  m+1  for  the  corrector),  the  method  is  stable  and 
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convergent  for  any  step  selection  scheme,  even  if  m  is  changed  from  step 
to  step,  and  from  predictor  to  corrector,  as  long  as  m  is  "bounded,  p(0 
satisfies  the  stability  condition,  p(l)  =  0,  and  m  >_  0. 

NOTE:   This  means  that  the  variable  step,  variable  order  Adams  method  is 
stable  for  any  step  and  order  selection  schemes. 


Proof 


Following  the  argument  used  in  Theorem  U,  the  3*   are  solutions 

i,n 

of  the  equations 

m  -1    1  k 

£  3*    (w. -co.  , .,  )to.    =  -—  £   a*  oj.  ,   1  <  r  <  m+1, 

.  _  i,n   l   l+l  l      r  .  .   i   x      —   — 

i=0  i=l 

(or  1  <  r  <  m  if  3~   =0  for  an  explicit  method).   Hence,  the  solutions 
—   —       0,n 

3?   (and  3.    for  an  explicit  method)  can  be  bounded  above.   Thus,  the 
i,n       i,n         ^ 

conditions  of  the  preceding  theorem  are  met,  and  the  method  satisfies  the 
stability  condition. 

The  order  of  the  corrector  will  be  at  least  one  if  m  >_  0;  hence 
the  truncation  error  can  be  bounded  by 

I  Id  I  I  <  h  e(h), 

where  e(h)   ■+  0  as  h  ■*  0 ,   so   the   conditions   of  Theorem  2.2   are  met.      Hence, 
the  method  is   convergent  and  stable. 

Q.E.D. 


Ik 

Theorem  2.4 

If  a  finite  set  of  either  explicit,   predictor-corrector,   or 
implicit  methods  are  based  on  Adams  formulas  using  the  interpolation 
step  changing  technique,   if  the  order  of  a  corrector  is  equal  to  or 
one  larger  than  the  order  of  its  predictor,   if  the  step  and  formula 
selection  schemes  are  such  that  there  exists  a  finite  constant  M  with 
the  property  that  in  any  M  or  more  consecutive  steps  there  are  at  least  p 
fixed  steps  using  a  predictor  of  order  r,  where  p=r  if  all  of  the  0    's   are 
the  identity,   or  p=r+l  if  the  difference  method — equations    (2.1)   and 
(2.2) — is  used,    then  the  methods  are  stable  and  convergent  with  respect 
to   those  selection  schemes  . 

Proof 

A  simple  extension  of  the  proof  of  Theorem  6  will  be  used  to 
show  that  the  method  satisfies  the  stability  criterion.   Then  Theorem  2.2 
shows  that  it  is  stable  and  convergent. 

For  the  equation  y'  =  0,  T  is  given  by 

T  M 
T  =    [I   -  I      e„]        AC  0   =R   C  0, 
n        — n  — 2       nn    nnn 

where  C  is  uniformly  bounded  by  the  definition  of  a  step  selection 

scheme,  and  0  is  uniformly  bounded  (it  is  either  I  or  as  given 

in  2.2).   If  0  <_  m  <_  M,   |T      is  uniformly  bounded.   From  the 

hypothesis  of  the  theorem,  we  are  guaranteed  that  in  any  M  or  more 

consecutive  T  's,  there  will  be  at  least  p  adjacent  in  which 
q 

C  =0  =  I  (no  change  in  step  or  order)  and  A  and  I      are  constant 
q    q  &        *  q.     -Q. 
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(no  change  in  order).   Thus, 

Tn+m  =  Tn+m  Rp  Tq 
n      q+p   q  n 


where  q-n  <_M.     R  is  given  by 

Si 


—       — 

R    JO 

R      = 

q 

i 

R    |0 

i    

where  R  is  the  (r+l)  x  (r+l)  matrix  defined  in  (U3)  and  R  is  either  all 
zero — if  all  0  are  the  identity,  or  contains  a  unit  entry  in  the  top 
right  position — if  the  order  increasing  technique  uses  the  A  given  in 
(2.1).   From  the  properties  of  R  given  in  [l],  it  follows  that 


R*  x  =  y  e, . 
q  —    x  —1 


As  in  Theorem  6, 

y   <_  C  J  |x|  I  . 

Since  e_  is  a  unit  eigen  vector  of  R  ,  C  ,  0  ,  and  hence  T  ,  we  have 


^+m   zl 
n   — ' 


^!>PTq  z|| 
q+P   q  n  — '  ' 


nn+m  RP 
'q+p   q 


"  R  ±J  I  where  21  =  T   z. 


^n+m 
q+P 


M  el   =  |y  I  I  |e.  I  I  =  |y  I  :  C  |  |x| 
x  — I1  '    '  x1  '  '— l1  '    '  x1  —   '  '— ' 


=  C   |Tq  zl I  <  C[Max  I  IT, I  I  ]q"n 
1  1  n  _m  _       M  jM 


Hence,  for  m  >  M, 
I |Tn+m| 


C[Max  I  |T. I  I ]M. 

J 


Thus,  the  method  satisfies  the  stability  condition  with  respect  to  the 
step  and  formula  selection  schemes  ,  and  so  is  stable  and  convergent. 
Q.E.D. 
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k.      GENERAL  METHODS 

Theorem  7  showed  that  a  fixed  formula  method  was  stable  with 
respect  to  small  step  sizes  for  both  variable  step  and  interpolation 
methods.   There  is  no  direct,  useful,  equivalent  in  the  sense  that  if  the 
class  of  formula  used  provides  one  or  a  few  of  each  order,  there  is  no 
such  concept  as  a  "small"  formula  change.   The  closest  similar  idea  is 
that  infrequent  formula  changes  do  not  cause  instability. 

Theorem  2.5 


If  a  variable  formula  method  is  suoh  that: 
(i)     each  formula  F.  is  strongly  stable, 
(ii)     each  formula  has  order  >_  1, 
(Hi)      the  order  ehanging  operations  0 .  .  are  exact 

for  the  equation  y '  =  0,    and   \\0 .  .\\    is  bounded, 

I'd 

(iv)      the  coefficients  in  the  methods  M.  are  uniformly  bounded, 

is 

then,   for  each  formula  F .   there  exists  an  integer  p.  such  that  the  method 

is  Is 

is  stable  and  convergent  with  respect  to  a  step  selection  scheme   6  that 
produces  small  step  changes  such  that 

hn+1-  =1  +  0(h) 


h 
n 


and  a  formula  selection  scheme  I  that  produces  infrequent  formula  changes 
in  the  sense  that  at   least  p.  steps  are   taken  without  formula  change  after 

Is 

the  formula  F.  has  been  selected. 
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Proof 

We  will  verify  that  the  hypotheses   of  Theorem  2.2   are  satisfied. 
Hypothesis    (iv)   of  this   theorem  assures   us   that  A     and   I     are  bounded  uniformly, 
Hypothesis    (ii)    tells -us   that  there  exists    an   e(h)   +  0   as   h  ->  0   such  that 

I  Id   I       <  h      e(h)  ¥ 

i_ni  i    _    n  n 

so  we  only  need  verify  the  stability  condition,  namely,  that  I  It  I 

is  uniformly  bounded.   Although  T  is  independent  of  the  differential 

equation  by  definition,  it  does  vary  with  step  size  and  with  order. 

First,  we  get  rid  of  the  step  size  variation  by  proving  a  slight 

extension  of  a  result  contained  in  Theorem  7-  As  there,  we  decompose 

T  into  T  ,  the  operator  for  constant  steps ,  and  h  T  ,  where  T  can  be 
n      n      *  *   '      n  n9       n 

bounded.  It  follows  directly  from  the  proof  of  Theorem  7  that  if  T^  and 

T  are  uniformly  bounded, then  T  is  uniformly  bounded. 
n  n 

In  order  to  bound  'x  ,  we  must  look  at  the  structure  of  the 

rr 

different   formulas   and  step  changing  operations  used.      We  have 

T     =  S.    0    , 
n  in 

where  S.  depends  only  on  the  formula  F.  used;  that  is,  it  is  the 

amplification  matrix  for  a  constant  step  method  applied  to  y'  =0. 

Since  the  methods  have  order  >  1,  S.  has  an  eigen  vector  with  ones  in 

—     l 

positions  corresponding  to  entries  for  y   .  in  y  and  zeros  elsewhere. 
This  eigen  vector,  say  x,  >  corresponds  to  the  eigen  value  one,  and  it 
is  simply  the  statement  that  the  method  is  exact  for  y  =  1,  y'  =  0. 
Since  the  formulas  are  strongly  stable,  all  other  eigen  values  of  S. 
are  less  than  one.   x  is  also  an  eigen  vector  of  0   corresponding  to 
X  =   1.   Although  T  is  a  product  of  different  matrices,  if  the  changes 


are  sufficiently  infrequent,  it  has  the  form 


T™  =  S.  ..  .S.   0   S.  ..  .S.   0   S.  ...§.   0 
n    ix    x   nx   i2    i2  n2   x3    ^     nR 
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•m 

We  will  show  that  the   operator  T     can  he  hounded  hecause   it   does  not   change 

n 

x_  ,    and  eventually   decreases    all  other  components   if  there   are   enough  S.'s 

of  the  same  index  next  to   each  other.      This   is   shown  in   Lemma  2.1  "below   (in 
t 

more   generality  than  needed  at  the  moment) . 

Q.E.D. 

Lemma  2 . 1 

Let  {S   }   and  {0^}  be   sets   of  q  x  q  matrices  with  the   following 
properties : 

(i)      If  {A..}    j    =1,...,    q,   are  the  eigen  values   of  S . ,   then 
there  exist   constants  v    and  r\    such  that 
1=   |X1#1|    -    |X1>2|    =...=   |A.jVl, 

i»n  Ll*i>v+1l.-">  lxi,4l'¥1- 

(ii)   There  exists  a  constant  linearly  independent  set  of 

vectors  xn,  x^,...,  x  of  norm  1  such  that 
— 1  -£      -u 

S.  x .  =  A  .  .  x.,j=l,...,v  and  ¥-  i . 
i  -J    1,J  "J 

(iii)      If  Q..    is   such  that   its   columns  have  a  norm  of  one   and 

0,7     S.    Q.    =  J.    is  the  Jordan   canonical  form  of  S. 
1111  i 

(without   loss   of  generality,  we   can  assume  that  the 
first  v    columns   of  Q.    are   x   , ...,    x   ),  then  there   exist 
constants   C    ,    C     such  that 

IIQ-1!!  <.clS  IJQ..II  <_c2  V  i. 

(iv)      0.    x.   =x.,j=l,...,v     and  V  i,   and  there   exists    a 
i  -J        -J 

constant    C^  such   that      lo.l       <    Cn   V   i . 
0  '  '     i '  '    —     0 

Then  for   any   constant  K   >   C     C     C     there   exists    a  set  of  integers    {pi>   such  that 

N  p 

n      [  (s . )    J   0  .  ]  |      <_  K         V-  N  >_  0 

whenever  p ,    >    p . . 
J   _     J 


Proof 


Hypotheses    (ii)    and   (iii)    imply  that  J.   has  the  form 


hi 


IV 


Hence,    SP  =  Q.    JP  Q71 
'      i  i     l     i 


Xil 


\ 


Jordan  blocks    for 
eigenvalues   of 

magnitude   <   n 


XP 


iv 


where,  from  hypothesis  (i), 


U. 
IP 
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— 

— 

AP 

l 

0 

^. 

-\ 

.   J_ 

0 

u. 
ip 





QT1, 


|X^  I  =  1,  1  <_  J  <_v  , 

and  the  elements  of  U.   are  bounded  by  terms  of  the  form  n    (  .)  for 

ip  J 

0  '.L  J  ^L  CL"V_1  and  p  >_  j  .   (These  arise  when  a  (j+l)  x  (j+l)  Jordan  block  is 
raised  to  the  power  p.)   Hence,  p  can  be  chosen  to  make  the  norm  of  U. 
as  small  as  desired. 


iP 
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Because  the  first  v    columns  of  Q.  are  independent  of  i— hypotheses 
(ii)  and  (iii) — and  "because  these  columns  are  unit  eigen  vectors  of  0., 


QT1  0.  Q.  n 
^i   i  ^i+1 


pu 


i2 


and  from  hypotheses    (iii)    and   (iv) 


piiM  ^0o0iV 


P12H    iC0ClC2 


(Note  that   C     >_  1  because   0.   has    a  unit   eigen  value  and  that   C-.    CL  >_  1  because 
1  =   |  \0,.    Q7    J  |    <.  C     C    . )      By  expansion 


i     i 


N  p. 

m  =    n    [(s. )  x  o.  ] 

i=l  X 


Pl   -1        P2      PN-1   -1       „    PN   -1 
*  Ql  Jl   Ql  °1  Q2  J2   ' ' '  JN-1  %-l   °N-1  QN  V  %     °N 


=  Q, 


N        p.      i       N-l        s        p. 


n    a, 

1-1  : 


N-l 


i    (  n    a.1)  p  ,  (    n      u.-    p.Ju - 

t       •   i      x  sl      •      ±i      iP-      i2     NpM 

s=l      i=l  i=s+l        *i  ^N 


N-l 

n    (u.-  p..)u  - 

.    .         lp.  i2      Np„ 

1=1          *i  ^N 


-1 


%  V 


A.    is   a  diagonal  matrix  with  unit  length   elements,  hence      |AP|      =  1. 

If  we   choose  p.    such  that 
l 

l|UipH    -C^C^-K   =  C3' 


whenever  p   >_  p.,  we  have 
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N-l  „   ._ 

|M||    <    I  1^1  I    lltfll    110,11    [1*     I      CoClC2    (C3CoClC2)   "  "S   C 

S=l 

♦  (c0c1c2c3)M-1  c3]        ■ 

C  C  0  c  -(c  c  c  c  )B 

C0C1C2C1 

<   c  c  r  Ti  +  - 1 

-  ViL2L1      1-WgC  J 

C0C1C2 


"oW 


=  K 

as   required. 
Q.E.D. 

Lemma  2.1   allows  the  matrices   S     to  have  more  than  one   eigen  value  on 

n 

the  unit  circle,  but  they  must  have  the  same  set  of  eigen  vectors  and 
simple  elementary  divisors  for  those  values.   Thus,  weakly  stable  methods 
could  be  considered.   However,  the  restriction  that  the  eigen  vectors 
match  is  usually  difficult  to  achieve  for  other  than  the  principle  eigen 
value  X  =  1.   If  the  eigen  values  do  not  match,  instability  can  occur  as 
shown  in 

Example  B 

Consider  the  two  weakly  stable  methods  based  on 

F,:        v         =v         +  B       h         v'    + 

1  ^n+l       yn-l       Pln     n-l  ^n     ■••' 

P«:        v         =  v     -  v         +v         +8       h         v1   +. . 

2  ^n+l       Jn       yn-l       °n-2        Pln     n-l  yn      
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(The  $.   can  "be  picked  to  get  any  order  desired.)   The  vector  of  saved 
in 

values  y  'will  be 

*n  =  [V  yn-l'  yn-2'hn-iyA"--]T' 
where  the  maximum  number  of  derivatives  used  in  the  two  formulas  must 
be  saved.   The  corresponding  amplification  matrices  are 


si  = 


0  10 
10  0 
0   10 

0 


S2  = 


1-11 

10   0 
0   10 


If  the  top  lefthand  3x3  block  blows  up,  we  will  not  have  a  stable  method, 
so  we  will  discard  the  rest.   Then  we  can  show 


,2k+2 


10  0 
0  10 
10   0 


k  >  0  , 
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M+l- 


1 

-1 

1 

1 

0 

0 

0 

1 

0 

k  >  0. 


If  we  use  a  simple  formula  changing  process  such  that  0.  .  =  I,  then  we 
can  consider 


aUk+lQ2£+2 
S2        bl 


2 

-1 

0 

1 

0 

0 

0 

1 

0 

k,  I    >   0, 


Since 


[s^+2sf+2f 


N+l  -N     0 

N        -N+l     0 

N-l     -N+2      0 


N   >    1 


k,£     >    0 


it   is   evident   that  no  matter  how  large  k  and  I    are,   the  product  will 
still  be  unbounded. 

Theorem  2.5    states  that  some  integers   p.    do   exist,  but  does 
not   give  a  very  useful   constructive  way  of  finding  the   smallest  values. 
However,   we   can   show  by  example  that  these    integers   are   greater  than  one 
in  some   cases . 


Example   C 


Consider  methods  based  on  the   formulas 


'< 


V      yn+l  =  2yn  "IT^n-l  +  h  yn-2  + 


I         h     v'        +. 
0,n     n  yn+l 


F2:      yn+l  =  i  yn-l  +  F  yn-2   +  B0,n  hn  yn+l  +' ' " * 


2k 

Both  of  these  formulas   are  strongly  stable.      (The   roots    of  F-^  and  Fg    are   1,   +1/2, 
+1/2,    and  1,   -1/2,   -1/2,   respectively.)   -If  ^  =    [y    ,  yn_±i  ^2'"'^  and  if 
we   ignore  the  derivative   terms  by   considering  the  equation  y'    =  0 ,  we   find 


2 

-5A 

lA 

sl  = 

1 

0 

0 

0. 

i 

0 

Hence , 


0 

3/k 

lA 

S2   = 

1 

0 

0 

0 

1 

0 

S1S2   = 


-5A     TA     2A 

0       3/4     lA 
10  0 


Since    I -7-  -/^-l    =  1 A6 
1    4  21 


The  eigen  values   of  S  S     are   1,   and  -3/k+_t—  . 
exceeds   one,    (S  S    )      is   unbounded,   so   alternating  formulas   each   step  will 
lead  to  instability. 

The  p.    were    calculated  for  the  backward  differentiation   formulas 
1 

using  the  interpolation   step   changing  technique  with   the   0.  .   =   I.      Let   S. 
be   the  stability  matrix  for  the  i-th  order  method  and  let 

Q.J.Q71  =   S.  ,        i  =   1 6. 

111  1 


The   Q.    and  J.    are  partitioned  as    follows: 
1  1  * 


/ 


25 


Q.   = 

i 


X       X       X       X       X       X 


Q- 


J.  = 


Each  Q.    is    chosen   so  that  the   columns    corresponding  to  the   zero  eigenvalues 

X.  .    of  S.    induced  by  its   extension   from  (i+l)-space   to   7-space    are   of  the 
ij  i 

form  e..      Q.      is   similarly  partitioned  to  yield  Q.    .      The  p.  .    are  then    chosen 

-J  i  i  ij 

as  the  smallest   integers    satisfying 


1    i 
_  J. 

X 

X 

X       X 

X 

X 

0 

0 

0 

0 

J. 

l 

0 

0 

1 ' 

1 

<  l, 


Each  p.  .    is   the  number  of  constant   order  steps    required  after  a   change    from 
order  i   to  order  j.      The   table   of  p.  .  below  was    calculated  by   Mr.    Mike   Ostrar. 


i x. 

1 

2 

3 

k 

5 

6 

1 

1 

1 

1 

2 

3 

6 

2 

1 

1 

1 

2 

3 

6 

3 

1 

1 

1 

2 

k 

9 

k 

1 

1 

1 

1 

k 

11 

5 

1 

1 

1 

1 

1 

5 

6 

1 

1 

1 

1 

2 

1 

If  an   order  change   of  at  most   one   is   used,   the   number  of  steps   p.    needed 
after  a  change  to   order  i    is   not  more   than   i-1. 

Although  we   did  not    calculate  similar  tables    for  the   interpolation 
technique  with   differencing   or  the   variable  step   technique,  we  believe   the 
tables  will  be   similar. 
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5 .   CONCLUSIONS 

Again,  on  limited  evidence,  the  variable  step  technique  seems 
to  "be  more  stable  than  the  interpolation  technique  when  formula  changing 
is  considered,  but  it  does  seem  valuable  to  restrict  the  frequency  with 
which  the  formulas  are  switched  in  all  but  Adams  methods.   Otherwise, 
the  recommendations  of  reference  [l]  are  unchanged. 
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